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Abstract 

Consider a lossy packet network of queues, communicating over a wireless medium. This paper presents a throughput- 
optimal transmission strategy for a unicast network when feedback is available, which has the following advantages: It requires 
a very limited form of acknowledgment feedback. It is completely distributed, and independent of the network topology. Finally, 
communication at the information theoretic cut-set rate requires no network coding and no rateless coding on the packets. This 
simple strategy consists of each node randomly choosing a packet from its buffer to transmit at each opportunity. However, the 
packet is only deleted from a node's buffer once it has been successfully received by the final destination. 

I. Introduction 

It is well know that in the point-to-point channel model, feedback can never increase the value of the information theoretic 
capacity [1]. However, there several significant advantages to having feedback. Feedback allows coding strategies which can 
significantly increase the probability of eiTor exponent, for example the Schalkwijk-Kailath scheme for additive Gaussian 
noise channels [2]. Feedback can also allow transmission strategies with extremely simple coding algorithms. Specifically, 
consider the binary symmetric erasure channel. When feedback is available, the transmitter can simply repeat each bit until 
successfully received. Capacity is achieved, and in some sense, no coding whatsoever is required. 
, In this paper, a unicast model of a lossy wireless network of queues is considered, similar in spirit to the wireless erasure 
^ ' network [3], [4]. Our network model is characterized by independent erasure channels/loss probabilities on a directed graph, 
1—1 a wireless broadcast requirement, asynchronous transmission timing, and unicast for a single source-destination pair. With 
transmit opportunities occurring as a unit rate Poisson process, a transmission by one node will be received independently 
'"1 with some fixed probability by each other node in the network. The network model will allow general feedback, but it will 
^ be shown that only a very limited form of acknowledgment feedback is required to achieve the throughput-optimal cut-set 
I— —I capacity. The primary differences between our model and that of [4] are first, the availability of feedback, and second, an 
asynchronous, memoryless aiTival process (rather than a slotted-time model). The authors do not believe the difference in 
' ^ timing model to be critical, and conjecture that the given transmission algorithm will be throughput-optimal in a slotted-time 
QQ model. Extensive simulation on the slotted-time model has inspired confidence in this conjecture. Additionally, the addition 
QNy of feedback eliminates the requirement for any side-information concerning the location of erasures throughout the network 
CS| to achieve capacity, in contrast with the decoding strategy of [4]. 

A similar asynchronous network model was studied in [5]. The authors' model demonstrates the usefulness of network 
■rj" coding: with no feedback, but allowing network coding and additionally, a packet header describing the linear combinations 
of data packets included in the transmission, they demonstrate the achievability of the cut-set bound. Our work highlights 
somewhat of a dual statement: without any sort of coding, but with feedback, the same cut-set packet rate is achievable. 
The paper [6] also is concerned with a similar wireless lossy packet network model. With a backpressure algorithm, 
^ throughput-optimality in a multi-commodity sense is also achieved in a multiple-source multiple-destination network. This 
k>( algorithm requires link-level feedback, and for each node to maintain knowledge of the queue state of, in worst case, every 
^ other node in the network. It provides a decision process, when multiple nodes in the network receive copies of the same 
^ packet, to determine which (if any) of those nodes should keep that packet and attempt to forward it onward. 

In contrast, the routing algorithm described in this paper is completely decentralized and requires no conferencing among 
nodes to decide who should "keep" a packet that it has received. Instead, there will in general be multiple copies of each 
packet throughout the network. 

Specifically, the algorithm is as follows: Whenever a node has an opportunity to transmit a packet, it will randomly 
choose one packet from its buffer. Every time that a packet successfully reaches the final destination node, that node will 
(errorlessly) broadcast an acknowledgment to every node in the system stating that this particular packet has successfully 
completed its transit of the network. Only after receiving this acknowledgment from the final destination node will any node 
remove the packet from its buffer Indeed, the entire network will then flush that packet from all the buffers. This paper 
shows via Foster's Theorem and an application of an appropriate and novel Lyapunov function the stability of all network 
queues under this operation as long as the input data rate is less than the minimum-cut of the network. The authors are 
unaware of previous uses of an exponential Lyapunov function of the form we consider in showing stability results. 
The advantages of this throughput optimal strategy include 
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• It requires no coding, particularly no network coding at intermediate nodes. 

• The only information that a packet header must contain is an identifier - no additional information is required. 

• It is completely decentralized. No coordination or conferencing, other than the acknowledgment feedback, is required. 

• It is topology independent. No node other than the source needs any information about the layout of the network. The 
source must only be given the value of the min-cut, which could even be adaptively estimated, if desired. 

• The only feedback required, a simple acknowledgment from the destination, is practically already implemented in real 
systems. 

The main thrust of this paper: A demonstration that, in this lossy wireless network, feedback obviates the need for coding, 
network coding in particular. 

11. Network Model and Notation 

Consider a directed (possibly cycUc) graph G{V, E) with n+2 nodes: a source node, a destination node, and n intermediate 
nodes. Label the source node s, the destination d, and index the other nodes as i e 1, .., n. To each edge pair (i, j) &V xV 
assign an erasure probability < ejj < 1. If the directed edge (i, j) does not exist in the graph, then assign e,j = 1. Define 

Because of the wireless nature of the model, when a node i transmits a packet, each other node in the system j has the 
probability jiij of successfully receiving that packet. The events that packets are dropped are independent, that is i.i.d. across 
time for any fixed edge and independent between every pair of edges. We will consider the case where the events 

corresponding to combinations of packet drops from a single transmitter at a fixed time can be correlated in a later section. 

Allow an infinite buffer to exist at each node in the network. Packets will exogenously arrive at the source node s according 
to a Poisson process with arrival rate A. At average rate 1 exponentially distributed intervals, each node in the network (other 
than the destination node) receives an opportunity to transmit a packet. 

Each packet has a unique identifier in its header. Therefore, if a node already has a copy of a particular packet and it 
receives that packet again, the contents of that node's buffer remain unchanged. 

A feedback mechanism exists such that when the destination node receives a packet, it instantaneously, via a delay-free 
feedback, notifies all of the other nodes in the system of that fact. All nodes in the system can then immediately remove 
that particular packet from their buffer. 

Finally, this asynchronous model does not consider any receiver interference or the possibility of simultaneous arrivals. 
It is, however, possible to take into account interference or collisions by appropriately assigning the erasure probabilities of 
the model, accounting for lost packets by increasing the probability of packet drops. 

III. Cut-set Upper Bound and Transmission Strategy 

Under any transmission strategy, the cut-set upper-bound remains vafid. Intuitively, the cut-set upper-bound is obtained 
by dividing the network into two parts S and 5*^ and creating two super-nodes. That is, by allowing free, unlimited 
communication among the nodes in S and among the nodes in , we can only increase the capacity of the system. 

With that in mind, let 5 be a subset of the n + 2 nodes such that s & S and d e S"". There are 2" such subsets. Let 
<S be the set of aU such subsets. The super-node created by joining aU nodes in S together wiU still have opportunities to 
transmit at exponentially distributed intervals, but now the sum rate will be \S\ - a rate of 1 for each node in S. For each 
node i G S, because of the unlimited free communication on the right side of the cut in S"^, as long as one of the nodes 
j e 5^ successfully receives the packet, we can count it in the total connmunication throughput. Therefore, define 

c(5)=^(i- n ^ij] (1) 

ies \ jeso J 

as the cut-set capacity for the subset 5*, i.e. an upperbound on the rate of packets that can be transmitted across the S — S'^ 
cut, exactly as per [4]. Note that this upperbound is valid whether or not there is feedback in the system. This is because the 
procedure for obtaining the cut-capacity reduces the network to a memoryless point-to-point channel, for which feedback 
does not increase capacity [1]. 
For convenience sake, define 

Ci{S) = l-lleij (2) 

for pairs {i, S) such that i G S. (7,(5) represents the contribution to the cut-set bound for the cut S from the node i € S. 
The total throughput T < C{S) then, for every subset S, and 
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In [4], the authors show that, with the packet erasure locations known at the destination and the appropriate use of network 
coding, this min-cut capacity is indeed achievable in a wireless erasure network. 

The authors would like to emphasize the key role that the subsets S will play in the proof and the derivation of the stability 
results. The minimum of C{S) over all S — cuts must emerge from any stability equations; therefore it is reasonable 
that each cut-set represented by S must play a role. As will be further explained, the sets S will become essential as indices 
to the variables ms which describe the state of our Markov chain model. It will become clear that as the state variable ms 
corresponding to the subset S becomes large, the requirement A < C{S) becomes a dominant constraint. 

The network operates in the following manner: At every transmission opportunity for a node, that node randomly chooses 
one of the packets in its buffer to transmit. If the buffer is empty, then that transmission opportunity is lost. Only when 
acknowledgment from the final destination d is received will a node remove a packet from its buffer; therefore in general 
there are multiple copies of each packet in the network. 

Theorem 1: Under this randomized transmission strategy, all queues in a wireless erasure network with feedback are 
stable as long as A < C{S) for all S e S. 

At first glance, this randomized strategy seems unnecessarily wasteful. Consider a network which is a simple serial line 
of queues. In this case, it is obvious that an optimal strategy, when link-level feedback is available, is to stop attempting to 
transmit a packet (and remove it from one's queue) as soon as it is successfully received at the next queue down the line. 
Leaving a successfully transmitted packet in the queue could result in the retransmission of that packet, possibly wasting a 
transmission opportunity that could be put to better use sending a new packet. 

However, the randomization is crucially important in achieving the minimum-cut value for this network and for a general 
network. To achieve the min-cut, it is essential that all transmitters on the min-cut boundary transmit packets at almost every 
channel use and that these packets be almost always distinct. As the input rate A increases, the min-cut slowly becomes the 
bottleneck of the network and the queues on its boundary will grow large. This will ensure that each transmitter always has 
a packet to transmit with high probability. The randomization in packet transmission guarantees that for such long queues 
the probability that two transmitters along the min-cut transmit the same packet is very low. Deterministic strategies, such 
as FIFO for example, cannot guarantee this without coordination, and so the randomized strategy is essential to achieving 
the optimal throughput in a completely decentralized manner 

In the line network in particular, edges which are not the minimum cut can afford to retransmit a certain number of 
packets, since they have extra capacity. In fact, edges which lie downstream of the minimum cut edge will have relatively 
short queue lengths (compared to the queues upstream of the minimum cut edge) since they can remove packets from their 
queue at a faster rate than those packets can arrive across the minimum cut edge. 

All queues upstream of the minimum cut, however, will have a relatively large number of packets. If many packets are 
transmitted multiple times across the minimum-cut edge, then the queue length at that edge will grow large. However, as 
the queue length grows large (with new arrivals), the probability of picking a "useless" packet will decrease as most of the 
packets in the queue have not yet been successfully sent. This unwanted probability will be made as arbitrarily small as 
required (depending on the ratio between A and the minimum /i) as the queue length grows. 

Note that strategies such as the one in [6] implement an algorithm to assure that there is only one copy of each packet in 
the network at a time. Such strategies necessarily require some amount of Unk-level feedback and inter-node communication 
to guarantee the single copy, under the broadcast nature of the wireless medium. The strategy of this paper eliminates the 
need for any additional intra-network communication, other than the single feedback acknowledgment. 

IV. Proof Preliminaries 
A. Notation and Description of Markov Chain Model 

Before formally beginning the proof of Theorem [T] some additional notation must be defined. 

The subset S has already been defined to be an element of S, which is essentially the power-set of n. Precisely, S 
differs the power-set of n only in that all 5 G 5 always include the source node s and never include destination node d. 
Equivalently, each element S can represent an index in the set {0, 1,2, ...,2" — 1}. With this notion, the length-n binary 
expansion of S indicates which of the n nodes are contained within the subset S. This yields a one-to-one correspondence 
between subsets, cut-sets, and indices, all represented by the overloaded notation S. 

A continuous time Markov chain model is used to describe the state of the queuing network. Transitions between states 
will occur when one of three different types of events happen in the network: 

> A new packet is received (at rate A) by the source node s. 

> A packet is successfully transmitted from some node i in the system to some subset of the receivers. 
• A packet is successfully received by the the destination node d and therefore exits the network. 

By the asynchronous, continuous time model of the network, no two of these events can occur simultaneously. 

In the n — 1 three node network, the size of the buffers at the source node s and the intermediate node 1 are sufficient 
to describe any state of the system. There must be more packets at the source node s than at the intermediate node 1 at 



any point in time. By the given network operation protocol, no packet is deleted from a queue until it reaches the final 
destination, so that if a packet is present anywhere within the system, it must be present at the source node s. 

One option for the state variable of the system is to use q — {q{s), q{l)), representing the lengths of the queues at source 
and relay nodes respectively. This notation has the disadvantage that there would exist constraints such as "the number of 
packets at 1 must be smaller than the number of packets at s", i.e. q{s) > q{l), on the state space. In addition, when a 
network contains more than a single intermediate node, knowing the queue lengths alone is not sufficient to describe the 
state of a system where multiple copies of each packet may occur at different nodes. When a packet leaves the network, the 
model must be able to determine at exactly which nodes in a system the queue lengths should be decreased. To completely 
describe the system state and to eliminate the need for any such constraints on state variables, we consider an alternate 
notation. 

Let mi be the number of packets which appear at both the nodes s and 1. Let mp be the number of packets which appear 
at the source node uniquely. Then the source node has a total of tuq + mi packets, while the relay node has exactly mi 
packets in its buffer 

This state description can be generalized to an n + 2 node network. The Markov chain describing the system state is a 
vector m with 2" dimensions: 

m= (TOo,mi,...,TOs,...,TO2"-i) (3) 

The dimensions of the state vector m are indexed by the subsets S S. The value ms is the number of packets which 
appear at every node i E S and at no node j e 5*^. Therefore, the number of packets q{i) which appear any node i s,d 
in the network is a function of m. Let 

■th 



Then 



Si — {S e 5 1 the i* -least significant bit in the binary expansion of 5 is a 1} 



while the destination node d retains no buffer, and the source node s has 
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packets in its buffer. 

Figure [U illustrates the queue lengths for a network with n = 2, using the binary expansion of the S indices. 
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q{s) = moo + moi + mio + niu 




q{2) = mio +mii 



Y ?(l)=moi+mii 



Fig. 1 . Relationship between queue lengths and m for the case n = 2 



B. Markov Chain Evolution - Transition Model 

To understand the evolution of the Markov chain model describing the state m of the queuing system, first take an example 
of the network where n = 1. 

Successful transmission events can cause four different kinds of transitions to the state vector m — (toq, mi). 

• There is an exogenous arrival to the system. In this case, the source node receives a new packet; the source is therefore 
the only node in the system which has that particular packet in its buffer Thus, the value of mo is increased by 1. 

• A packet that is present exclusively at the source node s can be successfully received by the destination d, and therefore 
flushed from the network. Note that this is a subset of the event a packet transmitted from the source is received by 
the destination - packets at the source can belong to either the subset mo (with probability toq/ (too + mi)) or to the 
subset mi. The value of mo is decreased by 1. 

• A packet that is present at the relay node, i.e. counted in the variable mi, can be successfully received by the destination 
d, and therefore flushed from the network. If this packet was transmitted by the source, it must have come from the set 
of TOi packets (with probabiHty mi/ (toq + mi)). If this packet was transmitter by the relay node 1, then by definition 



g(l) = nil 




q{s) = niQ + nil 

Fig. 2. A general ra = 1 wireless erasure network. 



it must have been one of the mi packets at both the source and the relay. In either case, the value of mi decreases by 
1. 

* If the transmitter selects a packet from the set of mp packets, and that packet is successfully received by node 1, but 
not by the receiver, then that particular packet would now be in both nodes' queues. In that case, we have a transition 
in which mo decreases by 1 (there is one less packet which is unique to node 1) and mi increases by 1 (there is one 
additional packet which is located at both the source node s and the relay node 1.) 

Each of these possible transitions and their individual rates are illustrated in Figure [3] 




Fig. 3. Possible transitions and transition rates from a state (mo, mi) in the n = 1 wireless erasure network. 



In general, a network with n relay nodes has these same three kinds of transitions: 

• A packet arrives at the source node, with rate A. In this case, mg increases by 1. 

• A packet (which exists in the subset 5*1 of nodes) exits the system from some node i, with rate 

Here, m^^ decreases by 1. 

• A packet (which exists in the subset 5*1) transmitted at some node i is successfully received at some subset of possible 
receiver nodes, at least one of which did not previously have that particular packet in its buffer In this case, let 5*2 be 
the new subset of nodes which have this packet. This constrains Si C 5*2, and this occurs with rate 

E ( n n ^ 



»esi \jeS2/Si j<fS2 
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Here, mg^ decreases by 1 while 771 5^ increases by 1. It is important to note that in this kind of transition, the subset 
5*2 whose variable ms^ increases must always be a superset of the subset 5*1 whose variable decreases. 

C. Queue Stability and Foster's Theorem 

We desire to show that, for any arrival rate A < minses C{S), all the queues in the network are stable. We associate 
stability with positive recurrence: A state in a Markov chain is positive recurrent if the expected return time to that state is 
finite. A Markov chain is positive recurrent if all states are positive recurrent. We first present a review of Foster's Theorem, 
which is the main proof mechanism [7]. 



Theorem 2: Foster's Theorem. Let the transition matrix P on the countable state space M be irreducible and suppose 
there exists a function V : M such that inf™ V{m) > — oo and 

PmkV{k) < oo for all m G F 



E 

fee A/ 



Pm,kV{k) < V{m) - 1 for all m ^ F 



for some finite set F. Then the corresponding homogeneous Markov chain is positive recurrent. 

Intuitively, the theorem states that as long as there is a Lyapunov function which is on average decreasing, then the value 
of that function cannot go to infinity with increasing time. 

V. Proof for the Case n 1 

This section contains a demonstration of the stability proof for the simplest network, the case where n = 1, illustrated in 
Figure |2] Note that for this particular network, the cut-set bound evaluates to 

min (1 - Csiesd, 1 - eid + 1 - fsd) 
Lemma 1: The network illustrated in Figure |2] is stable for 

N 1 

A < , ——z min (1 - esi^sd, 1 - cirf + 1 - Csd) 
iV + 1 1 + 

for any fixed > and J > 0. 

By choosing iV >> 1 and 5 « \ appropriately, for any A less than the cut-set bound, the randomized transmission 
policy with feedback stabilizes all the network queues. 
Proof: Consider the Lyapunov function 

V {mo, mi) =N{1 + + (1 + . (4) 

This Lyapunov function is "rewarded" (i.e. decreases) when toq decreases and penalized when mo increases. When a packet 
is received at the relay node, the function is rewarded (while mi increases, mo simultaneously decreases) and when a packet 
leaves the system (i.e. mi decreases) the function is also rewarded. 

We identify three different cases to study. These cases arise first, because several state transitions in the Markov chain of 
Figure [3] become unavailable in certain states (for example, when mo = a packet cannot transition from the subset mo to 
the subset mi). Secondly, some of the cases individually give rise to the required cut-set constraints on A that the cut-set 
bound requires. 

• Case 1: When mo — and mi > 0. 
« Case 2: When mo > and mi — 0. 

• Case 3: When both mo > and mi > 0. 

As previously stated, when one of the variables in the state description m is equal to zero, one or more transitions from the 
state transition Figure |3] become unavailable. 

A. Case 1 : mo = 

Evaluate the expected change in the value of the Lyapunov function T^(0,mi) to determine when it is bounded away 
from zero: 

A {V (1, m,i) - V{0, mi)) + (fna + fi,d) {¥{0, mi - 1) - V{0, mi)) < 
A (A^(l + Sy + (1 + (5)i+™i - iV(l + Sf - (1 + 5)™!) 

+ (Mid + A^sd) + + (1 + 5)'"i-i - N{1 + Sf - (1 + 5)'"i) < 
A {NS + (1 + <5)"i {1 + 6 - I)) + (/iid + /i,d) (1 + 6r'-' (1 - (1 + S)) < 
A(iV+(l + 5)'"0 < (Mirf + M.d)(l + <5P"' 



A < ii-Hd + l^sd) 



(1 + (5)"i + N 



The first line represents the change in Lyapunov function for all possible state transitions from the state m = (0,mi), 
weighted by the appropriate rates to calculate the expectation. The right hand side of the final inequality approaches as 
arbitrarily close to {^iid + Msd) as desired for sufficiently large mi. That is, for any given A < (/ii^ + /isd) xqry, there 
exists a finite mi such that the expected value of the Lyapunov function decreases for states m = (0, mi) for all mi > mi. 
Note that for this case, one of the two cut-set bounds on A is obtained. 



B. Case 2 : mi — 

For TO = (too, 0), Figure [3] indicates that we desire 



A {V (too + 1,0)- V{mo,0)) + fisd {V(mo - 1, 0) - V(too, 0)) + fisi^sd (V(too - 1, 1) - V(mo, 0)) < 
A {N{1 + + (1 + Sr") < fisd {Nil + Sr"-^ + (l + Sr^-^) + fisiesdNil + <5)"°-i 
\{N + 1)(1 + 6)< fisd^sdiN + 1) + fisiesdN 
1 N 1 



1 + 5 TV + 11 + 5 

As long as 



A < (1 - e>,d + Ssdi^ - esi)) , — — ^ = (1 - Csdesi) ■ 



N+11 + 5 ' ' N +11 + S 

then the expected value of the Lyapunov function decreases for all states of the form to — (toq, 0). 

C. Case 3 : too, mi > 

All of the transitions in Figure [3] are possible from the state to — (too, mi). 



+ ( Mid + Msd ; ) {V(mo, TOi - 1) - y(TOo, TOi)) 



A(y(TOo + 1, mi) - F(too, TOi)) 

TOl 

I ; 

Too + TOl 

+ ( ^JLsd — ^ — ) {v{mo - 1, TOl) - y(TOo, TOl)) 

Too + TOl / 

^J'sle-sd — ^ ) {V{mo - 1, TOl + 1) - 1^(too, toi)) < 

Too + TOl / 

AA^(1 + (5)"° + (1 + <5)'"°+"i 
< (m<i + M.d)(l + '5)"»+''"^'' 



^J■sd 



™" -N{\ + 5)""-l + (1 + 5)'»o+mi-l 



Too + TOl 



+ ^islesd^^^^N{l + 5y-«-' 
Too + TOl 

A(iV(l + 5) + (l + (5)™i+i) 

< (Mid + Msd) (1 + <5)"^ + (1 - e,ie,,) iV 

Too + TOl 

By inspection, note that regardless of the value of too, an m\ can be chosen sufficiently large such that if A < 
(/isi + Msd) TT?' the expected value of the Lyapunov function is decreasing for all states with TOi > m*i. Likewise, for any 
fixed TOl, choose too > Nmi, and if A < min(l — Csiesd, Mid + Msd), then the expected value of the Lyapunov function is 
decreasing. Thus, there are only a finite number of states where the expected value of Lyapunov function is increasing, and 
the requirements of Foster's Theorem are fulfilled. ■ 

VI. Proof for General Network 
Recall Theorem [U which we desire to prove: 

Theorem 1: Under the given randomized transmission strategy, all queues in a wireless erasure network with feedback 
are stable as long as A < C{S) for all S E S. 

For a general wireless erasure network with n+2 nodes, recall the Markov chain describing the system evolution described 
in Section IIV-AI Foster's Theorem is utilized to demonstrate the stability of this Markov chain for a general n + 2 node 
network. 

A. General Lyapunov Function 

For d. n + 2 node network, define the Lyapunov function V{rn) as 

l/(TO) = ^iV|5|(l + <5)^^'e-"^' (5) 
se5 



where the A^|5| and S are fixed constants. The iV|g| should jointly satisfy 

iV|s| > ^ iV|s,|. (6) 

S'DS 

To form some intuition on the particular choice of Equation (|5]l, consider the three kinds of transitions that can occur in our 
Markov Chain. When a packet arrives in the system, toq increases by 1, and the value of the Lyapunov function increases. 
Whenever any other transition occurs, the system is, in some sense, advancing a packet towards the final destination, and 
we would like the value of the Lyapunov function to decrease. This can happen in two ways: 

• A packet which appears in the subset 5*1 of nodes can exit the system. Then, ms\ will decrease, and all of the terms in 
the summation corresponding to S ^ Si will decrease in value, (i.e., those terms which contain the factor (1 + (5)™^i)- 
The Lyapunov function therefore decreases in value. 
« A packet which appears in the subset 5*1 of nodes will arrive at some other nodes, and then will appear in the subset 
5*2 D Si. Then, all the terms in the summation corresponding to S such that 5*1 C S, but 5*2 ^ S, will decrease in 
value (i.e. those which contain the factor (1 + (5)™^i but not (1 + (5)™'''2). However, those which contain both the factor 
(1 + (S)™^! and (1 + (5)'"^2 will remain unchanged (since nis-^ decreases by 1 and increases by 1). Note that, 
since C S2, whenever appears in an exponent, so does ms^- Thus, never appears in isolation and none 
of the terms in the Lyapunov function increase. 

B. Proof 

The proof of Theorem [T] follows directly from the following lemma: 

Lemma 2: The expected value of the function V{rn), defined in Equation (|5]l, is increasing only on a finite number of 
states whenever A < j^^j^^^ Tciinses C{S). 

Thus, for any A < minsg^ C{S), we can find an appropriate Lyapunov function to show the system's stability by choosing 
A'' sufficiently large and 5 sufficiently small. 
Proof: 

First fix 5 G 5, and examine the term in the main summation of Equation (|5]l corresponding that S. Then, determine 
which transitions of the Markov chain effect the value of that term. 
Let 

Fs(to) =iV|5| (1 + 5)^^'^^"^' . (7) 
An arrival to the system effects every Vs, since every term Vs contains toq- Thus MS £ S, 

Vs{mo + I, mi, ...) - Vs{mo,mi, ...) 

= iV|s| (1 + "^'+^ - 7V|s| (1 + ,5)^s'cs "s' 

= <5iV|s| (l + .Jj^^'es'"^' (8) 

These events occur at rate A. 

If a packet appearing in cut-set Si departs the system, precisely the terms Vs {m) when S ^ Si will decrease, since they 
are the only terms in the Lyapunov function Equation (|5]l which contain ms^. For S D Si, 

Vs{mQ,mi, ...,msi - 1, ...) - Vs{nio,mi, ...) 

= N,s\ (1 + (5)^^'es "^'"^ - iV|5| (1 + 



-(57V|si (1 + (9) 



i\S\ \^ ~t V) " " - JV|5| 

These events will occur when any node i E Si transmits a packet in Si which is successfully received by the destination node 
d. Given an opportunity to transmit, the node i chooses a packet in Si with probability — , and the packet is successfully 
received at the destination with probability fiid- Thus, packets from Si will leave the system with rate 

E (10) 

The final possible transition type occurs when a packet located at the nodes in subset Si is successfully received at some 
set of nodes which did not previously have that packet, but not the destination d, resulting in that packet being finally in 
the subset ^2 D Si. Thus 7715^ will decrease by 1, and will increase by 1. The only terms Vs{m) that will change are 
those containing mg^ but not tos2- Thus, for S such that S ^ Si and S ^ 5*2, 

Vs{mo,mi, ...,msi - 1, ...,tos2 + 1, ■•■) - Vs{mo,mi, ...) 
= 7V|s| (1 + ,5)^^'e^ "^'"^ - iV|s| (1 + (5)^s'cs ™s' 

= -(5A^|S| + (11) 



These events occur when any node i £ Si transmits a packet in Si, and that packet is successfully received by all the nodes 
j e S2/S1, and not successful in reaching nodes {j\j ^ 5*2}, including the destination node d. The total rate of such events 

E5t n A.. n^.- (12) 

The expected increase in the total Lyapunov function due to arrivals should be less than the expected decrease due to 
departures and transitions on all but a finite number of state m. The sum of changes over all of the terms must therefore 
satisfy 

A^iV|5|(l + <5)^-'£-'"-' 
ses 



<E E 

ses {(SuS2)\SigS2,SiCS,S2^s} \ies 



cs™s'-l 



(13) 



In the second line of Equation ( fT3T l. the first summation is over terms in the Lyapunov function. The second summation 
is over transitions of the possible pairs of 5*1 and 5*2 which will effect that particular term, and the third summation is over 
nodes which could possibly transmit and create that transition. The final terms of the second line represent the value of the 
change in that term Vs{rn)- 

Similarly, in the third line of Equation (fTsl l. the first summation is over the terms of the Lyapunov function, and the 
second is over the possible departures from the system which can effect the value of each term. Within the parentheses is 
the rate of those departures, and the final terms again represent the value of the change in the term Vs{m). 

Note that if q{i) = 0, that is, no packets are currently in the queue at node i, then for any S such that i G 5, ms — 0. 
In this case, take 

q{i) ~ " 

since this node cannot transmit any packets. 

Combining the two terms on the righthand side of Equation ( fT3] l yields 



^ ^ q(i) 



d+e,d n n ^^o\N\s\{l+5)^" 

We can simplify Equation (fT4l i by observing the fact that if ^4 ~ {1, 2, n} and < p ^ < 1 then 



Es'cs "'s 



(14) 



1= E n^. n (I-?'.) • (15) 

Equation (fTSl l can be proven by induction on the size of A, or by interpreting the as the probabilities that each of n 
independent events occur Each product term is the probability that exactly the subset Ai of the events occurs, and so the 
sum over all Ai's is 1. 

Fix some subset 5, another subset Si C S, and any i E S. Then, we have 



1= E n n ^ 

{S2|S'22Si} \jeS2/Si j^S2j#<i 



(16) 



E 



n n 



E 



n n 



{S2|S22Si,S2CS} \jeS2/Si ]'^S2.j^d 



{S2\S2DSuS2^S} \jeS2/Si J^S'2j#<i 



n ' 



E 



n n 



{S2|S23Si,S2CS} \jeS2/Si JGS/S2 



+ 



E 



n n 



{S2\S2DSi,S2<^S} VeS2/Si j^S2,j^d 



(17) 



(18) 



E 



n n 



{S2\S2DSuS2<^S} \jeS2/Si j^S2j#d 



n ^ 

jtSJ^d 



(19) 



where Equation ( fT6l ) is obtained as follows: for each 5*2 ^ 5*1, treat the S2/S1 as the Ai in ( fTSl l. Equation ( flTl l splits the 
summation, ( fTsT i factors out some e^, and ( fT9] l recognizes that the term in brackets in ( fTsT i is again equal to unity by ( fTSl ). 
Combining Equations ( fTSl ). ( fT4b . ( fT9l ). and recalling the definition of Ci{S) from Equation (|2]i yields the requirement 



A^7V|s|(l + 5) 
Se5 



f '!J!:S^n.(Q\ \ ^^ 
- Q{i) 

ses SiCs leSi ' ' 

We must show that Equation (l20l l holds for all but a finite number of states m. To begin, consider the states of the form 
m = (0, 0, 0, 7715", 0, ••■I 0), where all but a single one of the 2" variables ms — 0. As in Section|Vl each of these states 
will provide the individual cut-set bounds on A required for stability by the theorem. For m of this form. Equation ( |20l ) 
reduces to 

' + A ^ N\s\ (21) 

S^S" 

iV|si(i+<5r-"-i 

since ms^ = for all 5*1 ^ S" and nis" — when i E S". As long as Af|s"| is chosen such that 

Nis"\+ E <^|S"|^^ 

SDS" 

which is equivalent to the requirement of Equation we can replace Equation ( |2TI ) with 

N 




A^|S"|^^(l + <5) + A 7V|5|(l + <5)-™-"+^ <C(5")A^|S"|. (22) 

S^S" 

The left-hand side has been increased with the substitution. The right-hand side has been decreased, because all of the terms 
are positive, and instead of summing over all S E 5" in the outer summation, we include only the term where S = S". 
Therefore, satisfying Equation (l22l l assures that Equation (l2Tl i holds. 
Choose ms" such that 



iV|5| (1 + 6)-"'-"^' < ——(1 + Sy - -r-(l + S) 



and Equation ( l22b reduces to A < jj^-r ,,Ky^ C{S"). 



Thus, it has been shown that for states of the form m = (0, 0, 0, ms", 0, 0) whenever A < t^t /i+xy^ ^i^")' there 



N+l (l+<5)^' 

exists a rhs" sufficiently large such that the expected value of the Lyapunov function is decreasing for ms" > ms". Each 
of the required cut-set bounds on A for all of the different cuts S E S are obtained in this manner. 

It remains to show that there are only a finite number of general m = {ma, mi, ...,ms, ...,TO2"-i) where the expected 
value of the Lyapunov function is increasing. That is, we will demonstrate that the cutset bounds on A obtained above are 
sufficient to guarantee that Equation (|5]l is indeed a Lyapunov function for the queuing system. 

To do so, first examine the state variable m2>i_i; that is, the variable counting the number of packets which appear at 
every node in the system other than the destination. We will show that there exists a finite 7713" -1 for which, as long as 
™2"-i > "^2"-!' regardless of the value of mQ,mi, and every other state variable up to TO2"-2^ the expected value of the 
Lyapunov function Equation ( |20] i will be decreasing. 

Let S be the subset S E S which contains all n relay nodes and the source node ,s, i.e. the largest subset of the nodes. 
Also, let A^i^i = 1. Equation (|20] | can be rewritten as 

A (1 + ^)"'S+^s'cs ™s' _^ ^ ^ (1 _^ J)2:s'cs "S' 

ses 




ieSi 




9(0 



T;77V^''(^) I ^l^^l {1 + 5)^''^''^''-' (23) 



ieSi 



By dividing Equation ( [23] l through by 

(1 + (5)™s+Es'cs™s'-l ^ 

increasing the second term on the left-hand side, and decreasing the right-hand side by dropping the final term, the constraint 

X{1 + S) + X{1 + Sy-"'s J2 N\s\ (24) 
scs 

= E( E ^]QiS)=Y.^dS)-CiS) (25) 

is obtained. 

Therefore there exists a for which, for all states m with nig > m*^, regardless of the values of the other state variables, 
the expected value of the Lyapunov function will be decreasing when A < C{S) (^i^^y^ ■ 

Next, consider any set S which contains all but one of the n relay nodes. Rearrange the summations in Equation (l20l i to 
obtain the sufficient condition 



A5^iV|5|(l + <5)^-'^ 



ses 
< 



Ses \i£S 

Assume that rrig < m*.. If mj > it will be shown that Equation ( |26] l holds for any A < (i+s)'^ nii^SGS C{S). 

There are two cases to consider: 

> None of the nis other than m ~ are greater than m-^K. 

« At least one of the is greater than m~4rr- 

s ^ 

In the first case, divide all the sets 5* into two classes: S\ — \^S\S C S*} and . For S G S\, 

S{Si|5iCS,i6Si} "^Si ^ TOs" _ 1 



so term by term of the outer summation of Equation ( |26] |, when A < j^^ij^-^ C{S), the terms in the class iSi are satisfied. 
Now consider any of the terms in the class 5 G iSp. Divide both sides of Equation ( l26l ) by 

and note that TOs«m is greater than the sum in the exponent of the (1 + 5) for any the terms S G iSp by more than to|. 
The contribution to the left hand side from these terms becomes arbitrarily small, just as in Equation ( l24b . Equation ( l26b is 
thus satisfied when none of the other than are greater than TO|^. 

In the case where at least one of the other rag is greater than m-^, define 

s ^ 

Su^ U S 

{S\ms>m,^} 

as the union of all these sets S. The same analysis holds from the above case: For each term 5 G 5 of Equation (l26l l, either 
S D Su and the right hand side is greater than a fraction of C{S), or the exponent of that term is more than m*~ less 
than the exponent of the Sjj term, and is thus inconsequential. 

Define nig so that whenever jS"!! = 15*21 — 1, rrig^ > mg^^. The same arguments already made are used inductively to 
show that as long as mg > m*g for at least one S, then Equation ( |26] | is satisfied. ■ 
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Fig. 4. Queue Lengths Averaged over 500 Trials 

VII. Simulation Results 

The proposed transmission algorithm was simulated for a proof-of-concept. This section contains a description of the 
simulation methods and a presentation of the results. 

The simulation was preformed in a slotted-time model: At each time-step, a new packet arrives at the source node with a 
probability A. The simulation then loops over each node in the network, choosing a packet randomly from that node's queue, 
determining at which receivers the packet is successfully received, and adjusting the remaining queue states accordingly. 

The simulation was run on the network of Figure [T] with the erasure probabilities Esi = .6, £s2 = -5, e2d = -9, and 
eid = -l- The minimum cut of this network is the subset S = {s, 2}, where the min-cut capacity is .5 packets/timeslot. The 
source node received new packets at an arrival rate of A = .45. Figure H] plots the queue lengths for a simulation of 1500 
timesteps, averaged over 500 trial runs of the simulation. 

The source node and relay node 2, which are to the left of the minimum cut, have relatively longer average lengths than 
relay node 1, which is on the right side of the cutset. Additional simulations were performed for all three of the possible 
minimum-cut configurations of this network (by adjusting the erasure probabilities), and for various other simple network 
configurations. 

VIII. Model Discussion and Extensions 

The wireless erasure network with feedback model we study is designed to take into account the most salient characteristics 
of a wireless network. Namely, we model the wireless broadcast constraint on our directed graph, and consider the random 
erasures to be a model of an on/off type of fading. This model acts as something between a strictly physical layer model 
and a higher-level abstraction such as the network layer. For example, we assume that communication is packet-based and 
that the number of bits per packet, the error-protection level within a packet, and the modulation scheme are fixed. For 
analytical reasons, we assume that the feedback is instantaneous and perfect, that erasure events are all independent across 
both time and space, and that packets are received without interference. To justify the lack of interference we note, as in 
[4], that we assume some sort of interference-avoidance is already built into the network. Additionally, we conjecture that in 
a slotted-time model, correlation of error events at each receiver can be dealt with similarly as it is in [4]. Feedback delay 
and spatial correlation of erasure events are further discussed in this section. 

A. Non-Instantaneous and Imperfect Feedback 

Consider the case where, instead of immediately being available at all nodes, the feedback suffers from a delay which 
is exponentially distributed with mean D. The model of this paper can easily accommodate this extension: after the actual 
destination node of the network, insert at least D loss-free (e^j — 0) links in series. Create a new, virtual destination node at 
the end of this sequence of links. Adding in the new links does not decrease the cut-set bound, so the new network remains 
stable under the given transmission strategy. The new network acts precisely as the old network, with the inclusion of a 
delayed feedback that is at least as bad as exponentially distributed with mean D, performs. 

If the feedback is to contain errors, that it, if some of the relay nodes mistakenly do not receive feedback, this can be 
taken care of by allowing some Hnk level feedback: The network can include a mechanism by which, if a node receives a 



packet which that node has aheady determined should be flushed, it can send a single link-level feedback to the offending 
relay. Again, the process reduces simply to a network with feedback delay. 

B. Spatial Correlation of Dropped Packets 

It is also possible to consider a model the dropping of packets transmitted from each transmitter i E V aie correlated 
events. That is, if the node i transmits a packet, the probability that exactly the set C y successfully receives that packet 
can be considered to be p{i,W). In the independent model used in the majority of this paper, 

p{i,w) = Yi i^ij n 

jew jew'^j^i 

and 

just as observed in Equation ( fTSl ). 

The cut-set bound for the S — S'~' cut can still be interpreted as the sum of rates for which nodes in S can transmit and 
at least one node in S"-^ will successfully receive the packet: 

^(^) = E E (27) 

Replacing the transition probabilities in the Markov chain model with these p(i, W) requires no substantive changes in the 
proof technique - the values of the cutset bounds C{S) and the probabilities Ci{S) change accordingly, and the proof of 
queue stability follows. 

Allowing correlations across time for a single or multiple edges is a much different problem. An entire new set layers of 
the Markov chain would be required, and the whether the cut-set bound is achievable is still unknown in even the feedback- 
free model of [4]. Because of the asynchronous nature of our model, this same difficulty is encountered if it is desired to 
correlate erasures of packets from different transmitters. Such events would be simultaneous in the slotted-time model, and 
therefore are dealt with in [4], but would induce correlations over time in the model of this paper 

IX. Conclusion 

In this paper, we have demonstrated a parallel between the erasure channel and a network of such channels: When 
acknowledgment feedback is available, there exists a simple transmission strategy by which the information-theoretic capacity 
(calculated by the cut-set bound) can be achieved for a unicast network without any need for a coding scheme, and without 
any knowledge of the erasure probabilities. We have described a novel randomized and decentralized strategy which requires 
only a surprisingly small amount of information about the network (specifically, no knowledge whatsoever about the network 
topology) to succeed in stabilizing the queues and achieving throughput optimality. The main results shows a tradeoff between 
network coding and feedback - given one, the the other is not required to design a throughput optimal algorithm. 

While our randomized algorithm is throughput optimal, it will suffer in the metric of average packet delay. If we desire 
to transmit N packets through the network, for example, the total time required will be N/C + o{N), which is optimal, but 
the average delay for a given packet may be 8(A^) because of the randomization. Improving the delay performance will 
undoubtedly require more coordination and feedback among the nodes in the network and is worthy of further scrutiny, but 
beyond the scope of the current paper. 
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